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ABSTRACT 

A  branch -and -bound  algorithm,  which  finds  the  optimal  route  through 
n  nodes  when  a  different  cost  matrix  occurs  after  each  arc  in  the  sequence 
is  traversed,  is  presented.     The  route  may  begin  at  any  node  and  must 
pass  through  each  of  the  n  nodes  exactly  once.    The  objective  is  to  mini- 
mize total  cost  in  traversing  (n-1)  arcs  of  the  route.    The  cost  of  traversing 
each  arc  is  r..,  which  is  a  function  of  the  distance  between  nodes  i  and  i 
and  a  function  of  the  k      position  in  the  sequence  of  arcs  forming  the  route. 

The  algorithm  is  presented  in  step-by-step  detail  and  illustrated 
by  flow  chart  and  examples.    A  modification  for  symmetric  (r..)  improves 
the  efficiency  of  the  algorithm. 

A  trade-off  between  computation  time  and  storage  requirements  may 
be  accomplished  by  alternate  branching  policies.     Suboptimal  solutions 
may  be  obtained  with  reduced  computation. 
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I.     INTRODUCTION 

The  algorithm  presented  in  this  thesis  uses  the  branch -and -bound 

technique  to  find  the  optimal  route  through  n  nodes,  which  passes  through 

each  node  exactly  once,  while  any  two  of  the  nodes  may  be  chosen  for 

the  start  and  finish  of  the  route .    The  objective  is  to  minimize  total  cost 

in  traversing  the  (n-1)  arcs  of  the  route.    The  cost  of  traversing  each  arc 

if  r    ,  which  is  a  function  of  the  distance  between  nodes  i  and  i  and  a 
i] 

th 
function  of  the  k      position  in  the  sequence  of  arcs  forming  the  route. 

The  routing  problem  that  is  described  and  solved  is  closely  re- 
lated to  the  traveling  salesman  problem.    It  differs  in  that  the  route  is 
not  closed  and  that  a  different  cost  matrix  occurs  after  each  arc  in  the 
sequence  is  traversed. 

Since  the  branch-and -bound  methodology  is  used  successfully  by 
Little,  et  al,  [Ref.   1]  for  solving  the  traveling  salesman  problem  and 
is  recommended  by  Bellmore  and  Nemhauser  [Ref.  2]  for  medium-sized 
traveling  salesman  problems  of  13  to  70  nodes,   it  is  expected  that  the 
routing  algorithm  which  is  based  on  branch -and -bound  concepts  will 
provide  an  efficient  solution  to  the  sequence  dependent  routing  problem 
and  will  serve  as  an  alternative  to  dynamic  programming  with  its  large 
computer  storage  requirements . 

As  will  be  seen,  the  algorithm  successfully  solves  any  of  the 
general  class  of  sequence  dependent  routing  problems  for  which  the 


matrices  of  all  possible  costs  for  traversing  arcs  can  be  provided  at  each 
stage  in  the  sequence  of  arcs  which  form  a  complete  route. 


11  •     THE  BRANCH-AND-BOUND  METHOD 

A.         GENERAL  CHARACTERISTICS 

Virtually  all  programming  techniques,  including  linear  programming, 

dynamic  programming,  backtrack  programming  [Ref.  3],  and  branch-and- 

bound,  contrive  to  find  a  vector,  X*  =  (x*  x*    , x*) ,  which  optimizes 

1     z  n 

an  objective  function  f(X)  .     By  some  search  rule  elements  are  selected 

from  the  product  space  X  xX  x. .  .xX     of  n  "selection  spaces"  with  x.  an 

i      z  n 

element  of  X..    Hopefully  the  searching  procedure  will  be  considerably 
more  efficient  than  the  trial  of  all  possible  vectors  in  the  product  space. 

The  branch-and-bound  search  procedure  consists  of  selectively 
partitioning  the  product  space  and  then  computing  bounds  on  the  objective 
function  for  each  subset  of  the  partition  without  enumerating  all  vectors 
in  the  subset.    For  the  case  in  which  f(X)  is  to  be  minimized,  the  branch- 
and-bound  technique  first  constructs  a  lower  bound  on  f(X)  for  all  possible 
vectors  in  the  product  space.    In  the  next  step  of  the  branch-and-bound 
procedure,  the  set  of  all  possible  solution  vectors  is  partitioned  and  a 
tightened  lower  bound  on  f(X)  for  each  subspace  of  the  product  space  is 
calculated . 

As  an  example  of  these  two  steps,  consider  the  problem  of  mini- 
mizing f(x1  ,x2#  . .  .  ,x  )  equal  to  the  sum  of  the  elements  of  X  where 
each  of  the  elements  of  X  must  be  taken  from  a  different  row  and  column 
of  a  5x5  matrix.    For  the  first  step,  compute  the  sum  of  the  5  least 
elements  in  the  matrix  as  the  lower  bound  for  all  possible  solution 


vectors.     For  the  second  step,   select  an  element  of  the  matrix  to  be  x    . 

The  set  of  solution  vectors  is  now  partitioned  into  the  set  of  vectors 

which  have  x     =  a     ,  for  some  particular  i  and  j,  and  the  complement  of 
1         iJ 

that  set.    The  lower  bounds  must  be  calculated  for  each  of  the  two  subsets 
of  the  partition. 

In  general  for  the  branch-and -bound  search  procedure,  further  parti- 
tions ,  "branching"  ,  and  tightened  bounds  are  made  on  the  subset  which 

has  the  least  lower  bound.    After  sufficient  partitions  some  subset  will 

*      *  * 

contain  but  a  single  vector  (x.  ,x0  ,  .  .  .  ,x   )  and  the  bound  of  this  subset 

1      I  n 

*  *      *  * 

will  be  the  value  of  the  objective  function  z     =  f  (x     x_  ,  .  .  .  ,x  )  .    Any 

i      Z  n 

* 

of  the  subsets  which  have  lower  bounds  greater  than  z     cannot  contain 

the  optimal  solution  and  may  be  disregarded  in  the  search  for  the  optimal 

vector.     If  z     is  less  than  or  equal  to  all  the  lower  bounds  on  other  sub- 

*      *  *  * 

sets  ,    (x    ,x9  ,  .  .  .  ,x  )  is  an  optimal  solution.     If  z     is  greater  than  the 

lower  bound  for  some  subset  of  the  partitioned  selection  space,  that 
subset  must  be  further  partitioned  until  the  process  of  tightening  the 
lower  bound  proves  no  optimal  solution  vectors  are  present  in  that  sub- 
set, or  until  an  optimal  solution  vector  is  isolated. 

B.         BRANCH -AND-BOUND  NOTATION 

The  following  notation  is  used  in  the  literature  with  respect  to 
the  branch-and -bound  method  [Refs  .   1,5,  and  6]. 


X  a  subset  of  all  feasible  solution  vectors 

Y  a  subset  of  X 

Y  the  complement  of  Y  with  respect  to  X 

W(X)  a  bound  on  the  objective  function  for  all  possible 

solution  vectors  in  X 
The  subsets  are  usually  represented  as  the  nodes  in  a  tree  of  nodes 
and  branches  with  each  node  labeled  by  its  associated  bound. 


W(X)  =  1 


W(Y)  =  3      __^  /  X^~^      W(Y)  =  2 


Figures  similar  to  this  one  give  the  technique  its  name  of  branch- 
and-bound . 


III.     THE  ALGORITHM 

A.         BRANCH -AND-BOUND  NOTATION  FOR  THE  ROUTING  PROBLEM 

The  basic  method  of  the  algorithm  is  to  break  up  the  set  of  all 
possible  routes  through  n  nodes  into  smaller  and  smaller  subsets  and  to 
calculate  for  each  of  the  subsets  a  lower  bound  on  the  cost  of  the  best 
route  in  that  subset.    The  bounds  obtained  are  used  as  guides  for  the 
selection  of  further  partitions  into  smaller  subsets.    The  algorithm 
eventually  isolates  one  or  more  subsets  which  are  complete  routes 
whose  costs  are  less  than  or  equal  to  the  lower  bounds  for  all  other 
subsets.    Such  routes  are  optimal. 

Arc  (i,j)  has  the  usual  definition  from  network,  theory  [Ref.  4] 

i.e.  ,  a  directed  path  from  node  i  to  node  j .    The  term  "leg"  refers  to 
one  of  the  sequence  of  arcs  which  form  a  complete  route.    The  k      leg 
of  a  route  between  n  cities  is  that  arc  (i,j)  which  is  traversed  between 
the  k      and  (k+1)       cities  visited  in  sequence  on  the  route.    The  route 
between  n  cities  has  (n-1)  legs. 

As  described  in  Section  II,  the  algorithm  generates  a  tree  whose 
nodes  represent  subsets  of  routes.    The  notation  for  the  nodes  of  the 
tree  is: 

(i,j;k)    is  a  subset  of  routes  which  have  arc  (i,j)  for  the  k 
leg ,  and 

(ITL'k)    is  the  complement  of  (i,j;k). 
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Matrix  reduction  is  the  process  of  subtracting  the  minimum  element 
in  a  matrix  from  each  element  in  the  matrix  so  that  the  least  element  in 
the  reduced  matrix  is  zero.    The  amount  subtracted  from  each  element  is 
called  the  reducing  constant.    A  set  of  matrices  is  called  "reduced"  if 
the  least  element  in  each  matrix  is  zero. 

"Restriction"  of  the  set  of  cost  matrices  is  the  process  of  deleting 
the  matrices  and  arcs  which  are  no  longer  possible  for  the  subset  of 
routes  being  considered. 

Arcs  and  legs  are  said  to  have  been  "committed"  after  they  have 
been  chosen  to  define  a  subset  of  possible  routes.    When  (n-1)  arcs 
have  been  committed  to  (n-1)  legs,  a  route  is  completely  determined. 


Other  notation  used  in  the  algorithm  is  listed  below. 

L,  ,(r.. 
k      ij 


k  th 

R    ,(r..)  the  matrix  of  costs  of  traversing  arc  (i,j)  on  the  k 


leg  of  the  route. 

A,  ,  (a  .)  a  matrix  with  elements  that  are  the  distances  between 

k       13 

pairs  of  nodes . 

c  a  multiplier  (cost  per  unit  distance)  that  is  a  function 

k 

r         ,  ,     th 

of  the  k      sequence  position  of  a  route. 

g  **>    r  .  summed  over  the  set  of  (i,j;k)  for  committed 

^     i] 

arcs  and  legs  . 
M.  ,  (m..)        the  current  matrix  of  costs  of  traversing  arc  (i,j)  on 


k        ij; 


the  k      leg  of  the  route.    Initially  M     =  R     but  is 
changed  by  the  operation  of  the  algorithm. 
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M  the  reduced  form  of  M,  . 

k  k 

q(i    ,  j    ;k)      the  reducing  constant  for  M    . 

K       K  K 

q(i,  /J,  /"k)  =  min.min.m... 
k     k  1        3    ij 

x  represents  plus  infinity  as  a  matrix  element,    x  is 

used  as  an  element  in  a  cost  matrix  to  block  the  path 
between  the  associated  node  pair. 

W(X)  the  lower  bound  label  attached  to  the  tree  for  node  X. 

■ 

9(i,  ,j,  ;k)      the  second  smallest  element  in  M,  . 
k     k  k 

'k 
9(i,  ,j.  ;k)  =  min. .    ,   .    .    m. .   . 
k     k  13  t^   W    i] 

0(i    ,  j   ;k  )    =  max,    9(i    ,j    ;k) . 
o     o     o  k        k     k 

B.         DETAILS  OF  THE  BASIC  ALGORITHM 

The  algorithm,  which  is  listed  here  in  complete  detail,  uses  the 
branch-and-bound  technique  to  find  the  least  cost  route  between  n 
nodes  when  the  matrix  of  costs  changes  for  each  leg  in  sequence  on 

the  route.    It  is  assumed  that  the  set  of  matrices  R,    can  be  specified 

k 

for  all  (n-1)  legs  of  the  route.     The  range  of  values  for  the  elements 

of  R,    is  not  restricted, 
k 

A  simplified  flow  chart  of  the  algorithm  is  given  in  Section  III.B.2 


1  .         The  Steps  of  the  Basic  Algorithm 
Stop  1 

The  initial  set  up  of  the  algorithm  is  made  as 
fol  lows  . 


1 .  Set  M,    =  R,    for  k  =  1 , 2  ,  .  .  . ,  n . 

k        k 

2.  X  is  the  set  of  all  possible  routes. 

3.  Set  Z     equal  to  plus  infinity.     Z     will  be  the 

o  o 

cost  of  the  optimal  route  at  the  end  of  the 
algorithm. 
Step  2 

1 .  For  each  k  =  1 ,  2  ,.  .  .  ,  n-1 ,  find  i,  ,  j,  ,  and 

k     k 

q(i    ,j    ;k)  such  that  q(i    ,j    ;k)  =  min.min.  m... 

K       K  K       K  1  J         1J 

1  '  k  k 

2.  Reduce  M,    to  M,    where  m     =  m      -  q(i,  ,  j,  ;k) 

k  k  ij  ij  k     k 

for  all  i,  j  ,k . 

3.  Label  node  X  with  \A/"(X)  =     X  q(i    ,j,  ;k)  summed 

k     k 

over  k=  l,2,...,n-l. 
Step  3 

Choose  the  subset  for  the  next  tree  extension  by  the 

following  procedure . 

'k 
1 .         9(i    ,  j    ;k)  =  min. .   /  .    .     m . .'  for  all  k  of  un- 


1J  ^    k]k      lj 


i 


committed  legs.     9(i    ,  j    ;k)  is  infinity  if  M      is 

a  single  element. 

2.         9(i    ,j    ;k  )  =  max.    0(i    J    ;k). 
o     o     o  k        k     k 

3  .         Then  Y  =  (i    ,  j    ;k   )  and  "Y  =  (i    ,j    ;k   )  are  the 
o     o     o  o     o     o 

next  branches  from  X. 


Step  4 


Label  Y  by  W(Y)  =  W(X)  +  0(i    ,j    ;k  ) 

o     o     o 
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Step  5 

i 

1 .         Delete  M,      . 
k 
o 

2  .         a  .         Delete  all  elements  in  M,         .  except  row  i 

k   +  1  o 

o 

b.         Delete  columns  i     and  j     in  M, 

o  o  k  +  1 

o 

3  .         a  .         Delete  all  elements  in  M,         ,  except 

k    -  1 
o 

column  i    . 
o 

b.         Delete  rows  i     and  j     in  M, 

o  o  k   -  1 

o 

4.  Delete  rows  i     and  j     and  columns  i     and  j 

o  o  o  o 

in  all  M,    except  for  k  =  k     -  1  and  k     +  1 . 
k  o  o 

5.  Relabel  the  matrices  as  M,  . 

k 

6.  Leg  k     and  arc(i    ,j    )  are  now  committed. 

o  o     o 

Step  6 

1.  For  each  k,  where  leg  k  has  not  yet  been 

committed  to  a  route,  find  i,  ,  j,    and  g(i,  ,j,  ;k) 

k     k  k     k 

such  that  g(i,  ,  j,  ;k)  =  min.min.m. . . 
k     k  i        3    i] 

i  'k         k 

2.  Reduce  M,    to  M,    where  m      =  m. .  -  q(i,  ,j,  ;k) 

k  k  ij  ij  k     k 

for  all  i,j,k  of  uncommitted  arcs. 

3.  Label  Y  by  W(Y)  -  W(X)  +  V  q(i,  ,j,  ;k)  summed 

*-*        k     k 

over  k  for  uncommitted  legs. 
Step  7 

If  (n-2)  logs  of  the  route  have  been  committed  go  to 
Step  10  .    Otherwise  go  to  Step  8 . 
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Step  8 

1 .  Select  the  node  X  from  which  to  branch  by 
choosing  the  terminal  node  which  has  the 
smallest  label  W(X)  . 

2.  If  Z     is  less  than  or  equal  to  W(X) ,  the  optimal 

o 

route  has  been  found.     STOP. 

3.  If  X  ^  Y  of  Step  6   go  to  Step  3  .    Otherwise 
go  to  Step  9 . 


Step  9 


Set  up  the  cost  matrices  and  label  node  X  as  follows 

k 

(i,j;k)  for  committed  arcs  and  legs. 


r      summed  over  the  set  of 


2  .         If  no  legs  have  been  committed,   set  M,    =  R,  , 

k         k 

■ 

otherwise  set  M,  =  R,  . 
k        k 

3  .         Carry  out  substeps  1  through  5  of  Step  5  for 

each  of  the  committed  arcs  and  legs. 

4.  Block  paths  which  are  not  allowed. 

5.  Carry  out  Step  6  substeps  1  and  2. 

6.  Label  X  with  W(X)  =  g  +  q(i    ,  j    ;k)  summed  over 

K       K. 

k  for  the  uncommitted  legs. 
7  .         Go  to  Step  .3  . 


Step  10 


If  W(Y)  is  less  than  Z    ,  set  Z     =  W(Y)  .    Go  to  Step  8 

o  o 
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2  .         Flow  Chart  of  the  Basic  Algorithm 

The  flow  chart  of  the  basic  algorithm  is  given  on  the  next 
page. 


START 


BASIC 
ALGORITHM 


Step  1 

Mk=Rk  for  all  k 

X  is  the  set  of  all  routes. 

Z     is  infinity, 
o 

i  '" 

Step  2 


Reduce  each  M,    to  M    . 

k 

W(X)  ==  sum  of  reducing 
constants  . 

Label  X  with  WOO  . 


Step  3 


Choose  Y=(i    ,  j    ;k  )  for 
o     o     o 

next  tree  extension  by 

finding  9(i    ,  j    ;k   )  = 
o     o     o 

maXk9(ik'jk;k)- 


Step  4 


W(Y) 


1 


Label Y  by 


W(X)+9(i    ,j    ;k  ) 
o     o     o 


Step  5 


Form  a  new  set  of  M,    by 

k 

deleting  matrices  and 

elements  not  compatible 

with  committed  arc 

and  leg  (i    ,  j    ;k  )  . 

o     o 


Step  6 


1 


Reduce  M,    to  M,    and 
k  k 

label  Y  with  W(Y)  = 
W(X)  +  sum  of  the 
reducing  constants. 


r 


_  p  8 
Select  X  from  which 
to  branch  as  term- 
inal node  with 
smallest  W(X). 


\es 


Z    ^  W(X) 


Step  9 

Form  the  set  of 

reduced  matrices 

M,    for  X . 

k 


(N-2)  legs  been 
committed 
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C.        EXPLANATION  OF  THE  ALGORITHM  BY  EXAMPLE 

A  simple  numerical  example  will  be  used  to  illustrate  the  algorithm 
while  tracing  through  the  steps  detailed  in  Section  III,  B.l. 

A  Simple  Sequence-Dependent  Routing  Problem 

Suppose  an  itinerant  salesman  must  be  routed  so  that  his  travel 
expenses  are  minimized  while  visiting  5  different  cities.     He  must 
complete  a  leg  of  his  route  on  each  of  4  consecutive  days.    Travel  ex- 
penses vary  as  a  function  of  the  day  on  which  the  travel  occurs.    At 
certain  times  no  public  transportation  is  available  and  the  costs  reflect 
the  price  of  the  available  charter  transportation.    All  possible  costs 
have  been  tabulated  for  each  of  the  4  traveling  days  and  are  presented 
in  Figure  1 . 

Step  1 

The  set  of  M     are  the  set  of  matrices  of  Figure  1 . 

Step  2 

The  set  of  reducing  constants  is  q(l  ,2;1)  =  3  ;  q(2  , 3;2)  =  5 , 

q(5,4;3)  =  2  ,  and  q(4  ,5;4)  =  1 .    The  set  of  M,    is  reduced  to  the  set  of 

k 

M    shown  in  Figure  2  .     W(X)  =3  +  5  +  2  +  1  =  11,  which  is  the  sum  of 
the  four  reducing  constants. 

Since  the  route  must  have  four  legs,   it  must  as  a  minimum 
have  a  cost  equal  to  the  sum  of  the  least  elements  in  each  of  the  four 
cost  matrices.     Therefore  W(X)  is  indeed  a  valid  lower  bound. 
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Step  3 

9(i    ,  j    ;k)  =  1 , 1, 1 ,5  for  k  =  1,2,3,4  respectively.    Hence 
k     k 

9(i    ,j   ;k  )  =  0(4,  5;4)  =  5  and  the  two  subsets  (4,5;4)  and  (475;4)  are 
o     o     o 

chosen  for  the  next  extension  of  the  tree. 

Step  3  partitions  X  into  subsets  Y  and  Y  by  choosing  the  arc 
and  leg  on  which  to  base  the  next  branching.     The  object  is  to  include 
in  the  route  the  arc  and  leg  which  is  judged  most  likely  to  be  on  the 
optimal  route.    It  is  argued  that  one  of  the  zero  elements  is  a  likely 

candidate  to  be  on  the  optimal  route;  and  that  arc  and  leg  are  chosen 

'k 

which  have  m      equal  zero  and  which,   if  not  chosen,  cause  the  greatest 
ij 

possible  alternative  cost.    The  arc  and  leg  so  chosen  will  raise  the 

i 

bound  on  Y  the  most.    For  each  reduced  matrix  M,     a  9(i,  ,j,  ;k)  equal 

k  k     k 

to  the  second  smallest  element  in  the  matrix  is  calculated.     9(i,  ,j,  ;k)  = 

k     k 

0  if  M,     has  two  or  more  zero  elements.    The  maximum  over  k  of  the 
k 

9(i,  ,j,  ;k)  is  the  highest  cost  for  not  placing  the  zero  cost  arc  on  leg 
k     k 

k     of  the  route, 
o 

Step  4 

W(Y)  =  W(X)  +  9(4,  5;4)  =  16. 
Step  5 

The  new  restricted  set  of  M,    is  formed  by  eliminating  arcs 

in  the  M,     matrices  which  are  not  possible  for  subsets  of  routes  in  Y. 

k 

Since  the  subset  (4,5;4)  was  chosen,  the  restricted  set  of  M,    shown 

k 


in  Figure   3  are  formed  as  follows 
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1 .  Mis  deleted  . 

4 

1  '3 

2.  All  of  M    except  column  4  is  deleted,  and  m..  and 

'3 
m       are  also  deleted. 

I  I 

3.  Rows  and  columns  4  and  5  are  deleted  from  M    and  M 
The  restrictions  brought  about  by  the  choice  of  arc  (4,5)  for 

leg  4  are  now  satisfied.    Leg  3  must  end  at  city  4  and  no  other  legs  are 
allowed  to  start  or  end  at  cities  4  and  5.     It  should  be  clear  that  if  leg 
4  were  not  the  last  leg  in  the  route,  in  accordance  with  the  algorithm, 
leg  5  would  be  restricted  to  begin  at  city  5  and  the  restricted  form  of  M 
would  have  elements  only  in  row  5. 
Step  6 

The  set  of  g(i    , j    ;k)  =0,0,1  for  k  =  1,2,3  respectively. 
Hence  W(Y)  =  W(X)  +  1  =  12.    The  restrictions  introduced  in  Step  5  make 
it  impossible  to  use  the  zero  cost  arc  in  the  M     matrix  at  the  end  of 
Step  2  .    The  lower  bound  is  therefore  tightened  by  the  amount  of  the 
least  element  in  the  current  M    .    Figure  4  shows  the  set  of  reduced 

O 

matrices  and  Figure  5  shows  the  labeled  tree  that  has  been  constructed 

up  to  this  point. 

Step  7 

Only  one  leg  has  been  committed,   so  Step  8  is  next. 

Step  8 

Node  (4,5;4)  has  the  smallest  lower  bound  and  is  chosen 

for  the  next  X  from  which  to  branch.    Z     remains  infinity.    Since  X  is 

o 
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the  same  as  the  last  Y,  Step  3  is  executed  next.    Step  9  is  bypassed  in 
this  case  since  the  correct  set  of  M     is  available  from  the  end  of  Step  6 . 

K. 

Second  Iteration 

Based  on  the  set  of  matrices  in  Figure  4,   9(i    ,  j    ;k   )  = 

o     o     o 

9(3, 4;3)  in  Step  3  and  the  tree  is  extended  to  (3,4;3)  and  (3,4;3).     In 

i 

Step  4  W(Y)  =  12  +  5  =  17.    After  Step  6  the  set  of  M     is  that  of  Figure  6. 

Since  all  the  reducing  constants  are  zero,   (3,4;3)  is  labeled  with  W(X)  + 

0  =  12.     In  Step  8  (3,4;3)  is  selected  to  be  X  and  the  third  iteration  begins 

with  the  execution  of  Step  3  . 

Third  Iteration 

In  Step  3  Y  is  chosen  to  be  (1 , 2;1)  since  9(i    ,  1    ;k   )  = 
—  o     o     o 

9(1,2;!)  =  7.    Therefore  (172;  1)  is  labeled  with  19.    After  Step  5  only 
the  single  element  for  arc  (2,3)  in  leg  2  remains.    A  complete  route  is 
now  isolated  since  leg  2  with  only  one  possible  element  must  be  included. 
After  Step  6  the  cost  of  leg  2  is  incorporated  in  the  label  of  (1,2;1)  which 
is  now  also  the  total  cost  of  the  route.     Steps  7  and  1_0  are  executed  so 
that  Z     =12,  the  label  on  (1,2;1).    Finally,   since  no  terminal  node  has 
a  label  less  than  12,  the  algorithm  is  stopped  in  Step  8. 

The  optimal  route  is  (1,2)  ,   (2,3),    (3,4),    (4,5)  at  a  cost 
of  12.    The  completed  tree  for  the  problem  is  shown  in  Figure  7.    Whereas 
complete  enumeration  would  have  required  the  calculation  of  the  costs 
of  120  different  possible  combinations,  branch-and -bound  finds  the 
optimal  solution  by  calculating  the  complete  cost  of  but  a  single  route 
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and  the  lower  bound  on  three  other  sets  of  routes.    This  clearly  demon- 
strates the  powerful  potential  for  efficiency  of  the  branch-and-bound 
technique. 

If  the  calculation  of  a  label  for  a  node  in  branch-and-bound  is 
considered  comparable  to  the  evaluation  of  the  recursive  equation  for 
one  value  of  a  state  variable  in  dynamic  programming,  an  approximate 
comparison  of  efficiencies  between  branch-and-bound  and  dynamic 
programming  may  be  made.    The  dynamic  programming  solution  to  the 
problem  just  solved  would  have  required  evaluation  of  the  recursive 
equation  for  30  different  values  of  the  state  variable  and  30  comparisons 
to  select  the  optimal  route.    The  branch-and-bound  solution  requires 
the  calculation  of  7  node  labels  and  15  comparisons  for  both  the  select- 
ion of  the  X  nodes  from  which  to  branch  and  the  selection  of  the  Y  nodes 
for  tree  extension.     Consequently,  for  this  particular  problem,  the 
branch-and-bound  algorithm  is  the  more  efficient  solution  procedure. 

D.        A  CONSTANT  DISTANCE  AND  VARIABLE  COST  RATE  (C,  )  PROBLEM 

k 

A  problem  of  some  interest  is  the  minimum  cost  route  when  the 

cost  for  each  leg  is  the  product  of  distance  traveled  and  a  sequence 

dependent  cost  factor.    The  branch-and-bound  algorithm  is  used  to 

solve  this  type  of  problem  in  the  example  below. 

A  Constant  Distance,  Variable  Cost  Rate  Example 

The  optimal  route  passing  through  6  cities  is  desired.    The  cost 

■i.jv-1  between  a  given  pair  of  cities  is  c.  a.. .    c,    is  a  function  of  the 

k   ij         k 
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day  on  which  travel  is  performed  and  is  called  the  daily  cost  rate.     It  is 

assumed  that  each  leg  of  the  route  will  be  traversed  on  a  different  single 

day.    Five  days  are  required  for  travel.    The  cost  rate  (units  of  cost  per 

unit  distance)  for  each  day  is  given  in  Figure  8  and  the  distance  matrix 

in  Figure  9 . 

The  set  of  (n-1)  cost  matrices,  where  R,    =  c,  (a..),   is  formed  and 

k        k     lj 
i 

shown  in  Figure  10.    The  set  of  reduced  matrices  M     after  Step  2  of 
the  algorithm  is  shown  in  Figure  11.    After  the  first  iteration  of  the 
algorithm  is  completed  through  Step  6,  the  labeled  tree  is  that  shown 
in  Figure  12  .     Since  the  bound  on  the  left  hand  node  is  less  than  the 
bound  on  the  right  hand  node,  Step  9  of  the  algorithm  is  executed. 
Arc  (2,5)  is  blocked  for  leg  5  by  setting  m?     to  plus  infinity.    The  set 
of  matrices  is  reduced  and  shown  in  Figure  13.    The  sum  of  the  reducing 
constants  is  found  to  be  20.     Since  g  is  zero  (no  arcs  have  been  com- 
mitted in  this  subset),  the  label  for  the  node  is  20,  which  agrees  with 
that  determined  on  the  first  iteration  for  Y. 

The  completed  tree  for  this  example  is  shown  in  Figure  14.    Only 
one  complete  route  is  enumerated  by  the  algorithm,  the  optimal  route 
(2,5),    (5,1),   (1,6),    (6,3),    (3,4).     It  is  noteworthy  that  four  consecu- 
tive  nodes  in  the  left  most  branch  of  the  tree  have  the  same  lower  bound. 
Examination  of  the  reduced  matrices  for  (2  ,5;2)  reveals  the  reason. 

B(i    ,j    ;k)  in  each  matrix  of  Figure  15  is  zero.    All  of  the  9(i    ,  j    ;k) 

k     k  k     k 

remain  zero  in  Lit.  i  branches  until  sufficient  arcs  have  become  blocked 
to  maki    .a  least  on'    9(i.  ,  J  ;k)  differ  n1  Erom  zero. 
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The  question  arises  of  what  branching  rule  to  use  when  the  values 

of  9(i    ,  j    ;k)  are  equal  for  two  or  more  k.    Of  course,  the  best  branching 

choice  is  that  which  causes  as  few  other  iterations  as  possible.     But  no 

rule  that  can  be  proved  is  known  for  making  the  choice.    As  shown  in 

the  tree,  branching  choices  were  made  by  taking  zeroes  in  M,    in  the 

k 

order  in  which  they  appeared  in  the  matrix.    Leg  5  was  chosen  because 

c     was  the  highest  cost  rate  multiplier  and  the  route  cost  could  be 
o 

lessened  by  at  least  5  units  if  one  of  the  zero  valued  arcs  in  M     could 
be  placed  on  the  route. 

In  any  case  no  branching  rule  can  eliminate  the  further  branching 
required  from  (m-1)  left  hand  nodes  when  m  zeroes  occur  in  a  reduced 
matrix  that  is  not  symmetric.    In  Section  III.  E.  the  algorithm  for  the 
symmetric  cost  matrix  case  is  discussed. 

The  branch-and-bound  algorithm  required  the  calculation  of  33 
labels  and  required  the  performance  of  54  comparisons  in  order  to  choose 
Y  nodes  and  12  0  comparisons  to  find  the  X  nodes  from  which  to  branch. 
For  complete  enumeration  the  cost  of  720  different  routes  would  be 
computed  and  compared.    Dynamic  programming  would  require  62  evalua- 
tions of  the  recursive  equation  and  62  comparisons  to  find  the  optimal 
route.    The  structure  of  the  problem  solved  here  causes  numerous  branches 
and  increases  the  number  of  nodes  that  must  be  considered  in  the  search 
for  the  next  X  node  from  which  to  branch  further.    Consequently  for 
problems  which  generate  numerous  branches,  branch-and-bound  solu- 
tions may  be  inferior  in  efficiency  to  dynamic  programming. 
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E.         SYMMETRIC  COST  MATRICES 

l>         Efficiency  of  Basic  Algorithm  for  Symmetric  Cost  Matrices 

The  basic  algorithm  presented  in  Section  III.  B.  will  succes- 
sfully solve  the  routing  problem  when  all  cost  matrices  are  symmetric, 
but  with  poor  efficiency.     Symmetric  cost  matrices  cause  an  increase  in 
the  number  of  branches  because  every  reduced  matrix  will  have  two  zero 
elements  for  the  first  iteration  of  the  algorithm.    The  example  in  Section 
III.  D.  showed  that  multiple  zeroes  in  the  reduced  cost  matrices  cause 
the  branch -and -bound  algorithm  to  be  less  efficient.    A  short  example 
with  symmetric  cost  matrices  is  given  here  to  illustrate  the  difficulty 
inherent  in  symmetry  for  the  basic  algorithm. 

Figure  16  is  the  set  of  four  symmetric  cost  matrices  for 
which  a  minimal  cost  route  is  to  be  found.    Figure  17  is  the  solution 
tree  which  results  from  the  use  of  the  basic  algorithm  presented  in 
Section  III.  B.    Twice  in  the  leftmost  branch  of  Figure  17,  two  branchings 
occur  before  the  lower  bound  is  raised.    This  double  branching  caused  by 
symmetry  is  avoided  if  a  modification  of  the  basic  algorithm  is  used. 
2  •         Modification  to  the  Algorithm  for  Symmetric  Matrices 

In  the  modification  of  the  algorithm,  the  arcs  are  considered 
undirected  and  the  direction  of  the  route  is  not  specified  until  two  adja- 
cent legs  are  committed.    The  nodes  of  the  tree  are  redefined  as  (i,j  or  j,i;k) 
with  complementary  node  (171  and  JTl;k)  .    The  definition  of  a  "directed" 
leg  is  necessary  for  the  modified  algorithm. 
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Leg  k  is  said  to  be  "directed  (i,j)"  if  leg  k  is  committed  and 

the  only  possible  direction  for  the  route  in  leg  k  is  from  i  to  j . 

Step  5A  of  the  modified  algorithm  is  used  to  specify  direction 

for  the  set  of  directed  legs.    If  leg  k     is  already  directed,  Step  5  of  the 

o  — 

basic  algorithm  is  executed  following  Step  5B.     Step  5  is  more  restrictive 
than  Step  5C  of  the  modification,  in  the  sense  that  more  matrix  elements 
are  deleted.    Step  7  is  changed  in  order  that  the  direction  of  the  last  leg 
committed  to  the  route  can  be  determined.     Step  9  is  modified  to  account 
for  the  difference  between  "directed"  and  "undirected"  legs. 

Because  of  symmetry  only  upper  triangles  of  the  cost  matrices 

are  used  in  the  modified  algorithm.    This  results  in  a  reduction  of  storage 

2 
required  by  the  amount  n(n     -  l)/2. 

The  basic  algorithm  is  modified  for  the  symmetric  cost  matrices 
by  inserting  Step  5A,  Step  5B,  and  Step  5C  between  Step  4  and  Step  5  in 
the  basic  algorithm  and  by  making  changes  to  Step  7  and  Step  9  .    The 
details  of  the  modification  are  given  immediately  below. 

Step  5A 

1  .         If  neither  leg  (k     +  1)  nor  leg  (k     -  1)  has  been  com- 

o  o 

mitted  go  to  Step  5C ,  otherwise,  go  to  substep  2. 

2  .         Set  t  =  k   ,u  =  i   ,s  =  j .  .  Execute  the  first  of  substeps 

o  o  o 

3,  4,   5,  and  6,  which  is  applicable. 
3.         a.         M   Leg  (t  +  1)  has  undirected  arc  (p,q)  then 
(l)       if  s  •   p,  Leg  t  La  directed  (u,s)  and 
leg  (t  +  1)  is  directed  (p,q). 


(2)  if  s  =  q ,  leg  t  is  directed  (u,s)  and 
leg  (t  +  1)  is  directed  (q,p). 

(3)  if  u  =  p,  leg  t  is  directed  (s,u)  and 
leg  (t  +  1)  is  directed  (p,q). 

(4)  if  u  =  q,  leg  t  is  directed  (s,u)  and 
leg  (t  +  1)  is  directed  (q,p). 

b.         Then  if  leg  (t  -  1)  is  committed  and  undirected, 
set  t  =  t  -  1  and  execute  substep  4  below. 
Otherwise  go  to  Step  5B* 

4.  a.         If  leg  (t  +  1)  is  directed  (p,q)  and  leg  t  has 

undirected  arc  (u,s)     then 

(1)  if  s  =  p ,  leg  t  is  directed  (u ,  s) . 

(2)  if  u  =  p,  leg  t  is  directed  (s,u). 

b.         If  leg  (t  -  1)  is  committed  and  undirected,   set 
t  =  t  -  1  and  repeat  substep  4.    Otherwise  go 
to  Step  5B. 

5.  a.         If  leg  (t  -  1)  has  undirected  arc  (p,q)  then 

(1)  if  s  =  p ,  leg  t  is  directed  (s,u)  and 
leg  (t  -  1)  is  directed  (q,p)* 

(2)  if  s  =  q,  leg  t  is  directed  (s,u)  and 
leg  (t  -  1)  is  directed  (p,q). 

(3)  if  u  =  p,  leg  t  is  directed  (u,s)  and 
leg  (t  -  1)  is  directed  (q,p). 


35 


(4)        if  u  =  q,  leg  t  is  directed  (u,s)  and 
leg  (t  -  1)  is  directed  (p,q). 
b.         If  leg  (t  +  1)  is  committed  and  undirected,   set 

t  =  t  +  1  and  execute  substep  6  below.    Otherwise 
go  to  Step  5B. 
6.         a.         If  leg  (t  -  1)  is  directed  (p,q)  and  leg  t  has 
undirected  arc  (u  ,  s)  then 

(1)  if  s  =  q,  leg  t  is  directed  (s,u). 

(2)  if  u  =  q ,  leg  t  is  directed  (u ,  s) . 

b.         If  leg  (t  +  1)  is  committed  and  undirected,   set 

t  =  t  +  1  and  repeat  substep  6  .    Otherwise  go  to 

Step  5B. 

Step  5B 

If  leg  k     is  directed  (p,q)  as  a  result  of  Step  5A,  the 
o 

ordered  pair  for  Step  5  is  (i    ,  j   )  =  (p,  q) .    Go  to  Step  5  in  the  basic 
algorithm. 

Step  5C 


1 .  Delete  M,     . 

k 
o 

2.  Delete  all  elements  in  M,     ,.   except  rows  i 

k   +1  o 

o 

and  j    . 
o 

3.  Delete  all  elements  in  M  except  columns 

o 

i     and  j    . 
o  o 
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'k  'k 

4.  Delete  m.    .     or  m.    ,    ,  whichever  is  present 

i  J  ]   1 

00  00 

in  the  upper  triangle  of  the  matrix,  for  k  =  k     -  1 

o 

and  k  -  k     +  1 . 
o 

5.  Delete  rows  i     and  j     and  columns  i     and  j 

00  00 

in  all  matrices  except  M,       n  and  M.       ,  . 

k   +1  k   -1 

o  o 

60         Relabel  the  matrices  as  M,  . 

k 

7.  Leg  k     and  arc  (i   ,j   )  are  now  committed. 

o  o  Jo 

8.  Go  to  Step  6 . 
Changes  to  Step  7  and  Step  9 

1 .         In  Step  7  change  "  (n  -  2) "  to  "  (n  -  1) "  . 

2  .         Replace  substep  3  in  Step  9  with 

"3.    Carry  out  Step  5 ,  substeps  1  through  5, 
for  each  of  the  directed  legs  and  Step  5C , 
substeps  1  through  6,  for  each  of  the  com- 
mitted but  undirected  legs." 

3  .         An  Example  Using  the  Algorithm  Modified  for  Symmetric 
Cost  Matrices 

Once  again  suppose  a  minimum  cost  route  for  the  set  of 
matrices  in  Figure  16  is  to  be  found. 

First  Iteration 

The  set  of  reduced  triangular  M     at  the  end  of  Step  2  is 
shown  in  Figure  18.    The  reducing  constants  q(l ,  2;  1)  ,  q(2,3;2),  q(l,2;3) 
and  q(4,5;4)  are  equal  to  3,5,3,  and  1  respectively  so  that  the  label 
of  the  first  node  of  the  tree  is  12  . 
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In  Step  3  9(i    ,  j    ;k)  is  found  to  be  9(4    5;4)  which  equals  3. 
—        o     o 

In  the  modified  algorithm  the  Y  node  for  the  next  branch  is  chosen  to  be 

(4,5  or  5,4;4)  and  Y  is  the  complement  (4,5  and  5~74;4)  which  is  labeled 

by  W(X)  +  9(4,  5;4)  =  15  in  Step  4. 

Since  no  legs  have  been  committed  yet  in  this  first  iteration, 

Step  5C  is  executed  immediately  following  the  first  substep  of  Step  5A. 

M     is  deleted.    All  the  elements  in  M     except  columns  4  and  5  are 
ft  \j 

■  i 

deleted.     Columns  and  rows  4  and  5  are  deleted  in  M     and  M    .    The  set 

■ 

of  matrices  formed  by  restricting  the  set  of  M,     are  relabeled  as  the  set 

k 

of  M,    which  are  to  be  operated  upon  in  Step  6  and  which  are  shown  in 
k  — 

Figure  19. 

In  Step  6  q(3,4;3)  =  4  is  the  only  non-zero  reducing  constant 
so  that  Y  is  labeled  by  16.    Since  only  one  leg  of  the  route  has  been 
committed,  Step  8  follows  Step  7  . 

In  Step  8  (4,5  and  5,4;4)  is  selected  as  the  next  node  from 
which  to  branch. 

In  Step  9  g  =  0  since  no  legs  have  been  committed  in  the 
subset  being  partitioned  by  node  X.     M     is  set  equal  to  R     for  all  k. 

Substep  3  requires  no  action  since  there  are  no  committed  arcs  and  legs. 

4 

r.„    is  set  equal  to  infinity  in  order  to  block  arc  (4,5).    The  set  of  M,    is 
45  k 

reduced  by  substep  5  and  X  is  labeled  by  the  sum  of  the  reducing  con- 
stants which  equals  15.    Step  3  which  is  executed  next  begins  the  second 
iteration. 
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Second  Iteration 

At  the  end  of  Step  6,  Y  =  (3,4  or  4;3;4)  has  a  label  of  21  and 

Y  as  a  result  of  Step  4  has  a  label  of  20.     In  Step  8  (4,5  or  5,4;4)  has  the 

smallest  label  and  is  selected  as  the  branch  point  for  the  next  iteration. 

4 
In  Step  9  g  =  r       =  i  since  there  is  only  the  one  committed 

i 
leg.     M     is  set  equal  to  R     for  all  k„     Step  5C  is  carried  out  for  the  single 

committed  but  undirected  leg  4  with  arc  (4,5).     No  paths  need  be  blocked  in 

in  substep  4.    After  Step  9  is  completed  the  set  of  cost  matrices  formed 

for  the  next  iteration  is  given  in  Figure  20.    This  is  the  same  set  of 

matrices  which  would  have  been  formed  by  reducing  the  set  of  matrices 

after  Step  5C  in  the  first  iteration  which  are  shown  in  Figure  19. 

Third  Iteration 

9(i,,j    ;k  )  =  9(1,2:1)  =  4  in  Step  3,   so  Y  is  (1,2  or  2,  1;1)  . 
1     o     o  — 

As  a  result  of  Step  4  Y  is  labeled  by  20. 

Since  leg  2  has  not  yet  been  committed,  the  direction  of  the 

i 
route  is  still  not  determined,  and  Step  5C  follows  Step  5A.     M,   is 

deleted.    Row  3  is  deleted  from  M    .    After  being  redesignated  as  M    , 

the  new  M     and  M     are  shown  in  Figure  21. 

In  Step  6  all  reducing  constants  are  zero  causing  Y  to  be 
labeled  by  16.     In  Step  8  Y  becomes  the  chosen  branch  point  for  the 
next  iteration.     Step  9  is  not  required  in  the  present  iteration. 

Fourth  Iteratio 

9(i    ,  j    ;k   )  =  9(3,4;3)  in  Step  3.     Y  is  then  (3,4  or  4,3;3)  . 
o     o    o  — 

Y  is  labeled  by  26  in  Step  4.    Only  th     direction  (3  ,4)  is  compatible 
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with  the  arcs  specified  for  leg  4.    Leg  (k     +  1)  is  leg  4,  which  is  com- 

o 

mitted  and  undirected,   so  that  substep  3, a  is  applicable.    Therefore, 
leg  3  becomes  directed  (3,4)  and  leg  4  becomes  directed  (4,5).     Step  5 

follows  Step  5B.    At  the  end  of  Step  6  only  two  elements  in  the  single 

2  2 

matrix  M     remain,   m   _  =  6  and  m„     =  0.    Consequently  the  reducing 

constant  is  zero  and  Y  is  labeled  by  16.    The  next  X  for  branching  in 

Step  8  is  again  the  Y  at  the  end  of  Step  6. 

Final  Iteration 

The  single  zero  element  leads  to  (i  ,  j    ;k   )  equal  to  (2,3;2) 

o    o     o 

in  Step  3  .    Y  is  labeled  with  16  +  6  =  22  in  Step  4 .    For  Step  5A  leg 

(k     +  1)  is  leg  3  which  is  already  directed  so  that  substep  4. a  is 

applicable  and  leg  2  becomes  directed  (2,3).     Since  leg  1  is  undirected 

substep  4  is  repeated,  and  leg  1  becomes  directed  (1,2).     In  Step  5  the 

last  matrix  is  deleted.     Since  all  legs  have  been  committed,   in  Step  6 

Y  retains  the  same  label  as  X  which  is  16.     (n  -  1)  legs  of  the  route 

have  now  been  assigned  so  that  Step  10  follows  Step  7  .     In  Step  10  Z 

is  set  equal  to  16.     In  Step  8  Z     is  found  to  be  less  than  or  equal  to 

o 

the  smallest  label  on  any  terminal  node.    Therefore,  the  optimal  route 
has  been  isolated  and  the  algorithm  is  terminated. 

The  final  solution  tree  is  given  in  Figure  22.    Only  one 
connected  path  is  contained  in  the  nodes  listed  in  the  tree.    The  set  of 
directed  legs  form  the  optimal  route  (1 , 2) ,    (2,3),   (3,4),    (4,5).    A  com- 
parison of  Figures  16  and  22  shows  that  three  branchings  in  the  leftmost 
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portion  of  the  tree  are  eliminated  by  the  use  of  the  modified  algorithm. 
For  large  problems  the  modified  algorithm  is  expected  to  produce  sig- 
nificant savings  in  storage  and  computer  run  time. 

F .         ADDITIONAL  APPLICATIONS 

Numerous  applications  may  be  constructed  which  specify  arrival 
times,  departure  times,  lay-overs,  and  other  aspects  of  a  routing 
problem.    The  following  examples  show  that  certain  kinds  of  constraints 
can  be  quite  easily  entered  into  the  algorithm. 

1 .         A  Constraint  Specifying  an  Arrival  Date  for  a  Given  City 

Suppose  travel  times  vary  because  of  transportation  schedules 

and  the  objective  is  to  minimize  travel  time  with  the  additional  con- 

straint  that  the  route  must  arrive  at  city  m  on  the  k      day  of  travel  over 

the  route.    The  constraint  is  easily  entered  by  restricting  R    to  column 

k  and  R,     „  to  row  m  ,  since  arrival  at  city  m  must  occur  on  leg  k  and 
k+1 

departure  from  city  m  must  occur  on  leg  (k  +  1) . 

2  .         A  Constraint  Specifying  an  Arc  of  the  Route 

Suppose  the  objective  is  a  minimum  cost  route  with  the 
constraint  that  one  leg  will  connect  city  p  to  city  q.    The  constraint 
is  entered  by  blocking  all  arcs  from  city  p  to  cities  other  than  q  and 
blocking  all  arcs  to  q  from  other  cities  than  p  in  all  of  the  set  of  M    . 

3  .         A  Minimum  Weight-Distance  Shipping  Route  Problem 

A  domestic  firm  has  ordered  8  units  of  heavy  industrial  equip- 
ment from  a  foreign  manufacturer  and  desires  to  minimize  the  costs  of 
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transporting  these  units  to  the  plant  sites  that  require  them.    The  manu- 
facturer will  deliver  all  the  units  to  a  single  point  of  entry.    The  firm  may- 
choose  any  one  of  the  plant  sites  as  the  point  of  entry  without  any  addi- 
tional charges  by  the  manufacturer.    The  firm  must  then  use  a  special  van 
to  transport  and  install  each  of  the  units  of  equipment  in  each  of  the 
several  plant  sites. 

The  cost  of  transportation  of  the  units  is  proportional  to  the 
weight-distance  hauled.     In  addition,   a  minimum  cost  per  unit  per  day  on 
board  is  incurred  when  the  special  van  is  not  moved  a  minimum  distance 
in  a  day.     Each  unit  of  equipment  weighs  the  same.    The  number  of  units 
for  each  plant  site  is  given  below., 

Number  of  units  Plant  Number 

1  1 

2  2 

1  3 

2  4 
1  5 
1  6 

The  distance  between  sites  is  symmetric,   so  the  transpor- 
tation costs  per  unit  for  haulage  between  sites  is  symmetric  and  is 
given  in  the  triangular  matrix  in  Figure  23. 

A  unit  can  be  installed  on  the  same  day  that  it  arrives  at  a 
plant  site.     But  no  more  than  one  unit  can  be  installed  on  a  single  day, 
so  that  charges  for  a  day  of  storage  result  for  each  additional  unit 
installed  at  the  same  site. 
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The  first  unit  is  installed  at  the  time  of  arrival  of  the  entire 
shipment  at  the  first  plant  site.    Thereafter  the  costs  are  based  on  the 
number  of  units  hauled  or  stored  until  the  special  van  is  empty. 

Site  2  and  site  4  are  made  into  two  sites  each  so  that  the 
storage  cost  of  10  per  unit  per  day  may  be  entered  into  the  cost  matrix 
as  shown  in  Figure  24.    The  problem  is  now  in  the  form  amenable  to 
solution  by  the  routing  algorithm.    A  unit  of  equipment  is  installed  on 
each  leg  of  the  route,  and  the  cost  for  the  leg  is  the  product  of  one 
element  from  the  cost-per-unit  matrix  times  the  number  of  units  left  at 
the  beginning  of  that  leg.     In  the  notation  of  Section  III.  A.    (c    ,  c    ,  .  .  .  , 
c   )  =  (7 , 6,  . . .  f  1) ,  each  c     is  the  number  of  units  yet  to  be  installed 

/  K 

at  the  beginning  of  the  k      leg.     (a    )  is  the  cost  matrix  of  Figure  24. 

i] 

R     =  c    (a . .)  for  k.  =  1 , 2  ,  . .  . ,  7  .    Since  each  of  the  R     is  symmetric  ,  the 

K.  K.       1 J  K. 

algorithm  as  modified  in  Section  III.  E.  may  be  used  to  find  the  sequence 
of  deliveries  of  the  equipment  which  minimizes  the  cost  to  the  firm. 
4  .         Problems  Including  Both  Cost  and  Profit 

Although  only  non-negative  elements  have  been  used  in  the 
cost  matrices  of  the  examples,  negative  costs  are  permitted;  and,   in 
fact,  with  the  use  of  negative  elements,  negative  labels  may  occur  in 
the  tree  constructed  by  the  algorithm.     Consequently,   net  costs  after 
subtracting  profits  for  a  given  day's  travel  may  be  entered  in  the  cost 
matrices.    The  algorithm  is  then  used  to  produce  the  optimal  net  cost 
route  which  will  have  value  less  than  zero  if  there  is  an  overall  ne1 
profit . 
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G.         SPECIAL  CASES  SOLVED  BETTER  BY  OTHER  METHODS 

1 .         Identical  Cost  Matrices  for  Each  Leg 

Suppose  the  optimum  route  is  desired  where  R    =  R    for  all 

i         J 

i,j.    This  problem  may  be  more  efficiently  solved  by  converting  it  to  a 

traveling  salesman  problem  by  injecting  one  more  city,   say  city  (n  +  1)  , 

and  specifying  that  r      ,    .  =  r         ,  =  0  for  i ,  i  =  1 , 2  . .  .    .,n.    The  recom- 

n+l,j        i,n+l 

mendations  of  Ref .   1  may  then  be  followed  in  finding  an  efficient  way  to 
solve  the  problem.     The  optimal  traveling  salesman  route  will  contain 
the  optimal  route  through  the  original  n  cities.    The  beginning  and  end 
of  the  optimal  route  desired  are  the  cities  which  connect  with  the  arti- 
ficial city  that  was  injected  to  obtain  a  solution. 

2  .         Cost  Rate  Constants  Form  a  Monotonic  Sequence 

If  the  optimal  route  is  to  be  found  from  a  set  of  (r..)  matrices 

where  r..  =  c,  a.,  and  if  the  set  of  c,    and  the  matrix  (a..)  have  special 
i]         k   13  k  i] 

properties,  the  optimal  route  may  be  found  very  simply  without  recourse 

to  this  algorithm. 

If  the  set  of  c,    form  a  monotonically  decreasing  sequence  for 
k 

k  =  1 ,2  ,  .  .  .  ,  (n  -  1) ,  and  if  the  shortest  route  using  the  distances  in 

(a    )is  found  to  be  a  monotonically  increasing  sequence  of  arc  lengths, 
ij 

the  least  cost  route  is  the  same  as  the  shortest  route  of  (a..)  .    Further- 
more, the  cost  of  the  optimal  route  is  the  sum  of  the  pairwise  products 
of  the  elements  taken  in  order  from  each  of  the  two  sequences.    The  same 
result  is  true  if  the  directions  of  monotonicity  were  reversed  for  both 
sequences . 
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A  theorem  with  respect  to  the  minimum  sum  of  pairwise 
products  of  the  elements  of  an  ascending  and  a  descending  sequence  is 
presented  inRef.   5, 
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IV.     DISCUSSION 

The  sequence  dependent  route  through  n  cities  is  closely  akin  to 
the  traveling  salesman  problem .    In  fact  if  an  additional  leg  were  added 
to  close  the  circuit  back  to  the  start  of  the  route,  the  problem  would  be 
that  of  the  traveling  salesman  with  route  costs  changing  after  each  arc 
is  traversed.    Consequently,  the  literature  on  the  traveling  salesman 
problem  -  in  particular  Little,  et  al  [Ref.   1]  ,  the  survey  of  the  traveling 
salesman  problem  by  Bellmore  and  Nemhauser  [Ref.  2]  ,  and  the  survey 
of  the  branch-and -bound  method  by  Lawler  and  Wood  [Ref.  6]  -  contain 
much  relevant  comment. 

A.         BRANCH -AND -BOUND  COMPARED  WITH  DYNAMIC  PROGRAMMING 
The  number  of  computations,  the  storage  space,  and  solution  time 
required  for  the  solution  of  the  optimal  route  problem  are  exactly  deter- 
mined by  the  number  of  elements  in  the  cost  matrices  when  dynamic 
programming  is  the  solution  method.    These  three  factors  are  quite 
variable  for  the  branch -and -bound  method.    All  three  depend  on  the 
number  of  nodes  which  must  be  generated  in  the  tree  to  solve  the  problem. 
In  many  cases,  such  as  the  example  in  Section  III.  B.  branch-and-bound 
is  superior  to  dynamic  programming  in  all  three  factors  .    Comparison 
for  the  traveling  salesman  problem  in  Ref.  2  shows  that  branch-and- 
bound  provides  lower  average  solution  times  with  a  much  larger  variance 
than  similar  problems  solved  by  dynamic  programming.    For  practical 
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purposes  dynamic  programming  is  restricted  to  the  solution  of  routing 
problems  with  fewer  than  15  nodes  on  the  route.    The  storage  requirements 
for  the  values  of  the  recursive  functions  in  dynamic  programming  for  a 
15  node  problem  is  24,024  [Ref.  2].    For  larger  problems  branch -and -bound 
methods  prove  superior  by  reducing  the  storage  requirement. 

B.         STRATEGIES  OF  BRANCHING 

The  strategy  used  for  the  selection  of  the  next  branch  point  has  a 
direct  effect  on  the  storage  requirements  for  the  branch-and-bound 
algorithm  to  solve  the  routing  problem.    The  policy  used  in  the  flow  chart 
is  to  branch  from  the  lowest  bound.    This  policy  has  the  advantage  of 
minimizing  total  computation,   in  the  sense  that  any  branching  performed 
is  also  that  which  must  be  performed  under  any  alternate  policy.    How- 
ever, under  a  "branch  from  the  lowest  bound"  policy,  no  terminal  nodes 
are  discarded  and  the  volume  of  storage  may  become  excessive.    The 
alternate  strategy  is  to  branch  always  from  the  newest  active  node  and 
to  discard  nodes  from  storage  that  are  out  of  the  competition  for  the 

optimal  route.    Very  few  nodes  are  then  kept  in  storage on  the 

order  of  a  few  n  [Ref.   1]  .    For  this  second  strategy  in  the  routing 
algorithm,  branching  would  always  be  to  the  right  until  a  complete  route 
was  enumerated  or  the  bound  exceeded  the  cost  of  a  complete  route 
already  found.    Then  the  process  would  work  backwards  up  the  branch 
until  a  left  hand  node  with  lower  bound  less  than  the  cost  of  the  completed 
route  was  found.    The  nodes  that  were  passed  by  could  be  discarded  from 
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storage  and  branching  would  be  continuously  to  the  right  again  from  the 
selected  node.    This  procedure  saves  storage  but  increases  the  number 
of  computations  and  the  solution  time  because  many  nodes  are  calculated 
unnecessarily  when  compared  with  the  first  strategy. 

C .         SUBOPTIMIZATION 

A  very  useful  feature  of  the  branch-and -bound  routing  algorithm 
is  that  it  allows  accepting  the  solution  and  terminating  the  computation 
when  a  satisfactory  suboptimization  solution  has  been  found.    For  in- 
stance,  if  the  objective  is  to  find  a  route  that  meets  a  budget  constraint, 
the  branch  to  the  right  strategy  may  be  used,  and  the  computation  ends 
as  soon  as  a  single  route  with  cost  less  than  the  budget  constraint  has 
been  found;  or  using  the  branch  from  the  lowest  bound  policy,  computa- 
tion ends  when  it  is  determined  that  no  route  less  than  the  budget  con- 
straint exists.     In  addition  Ref.   6  gives  branch-and-bound  search 
procedures  that  are  applicable  to  the  routing  algorithm  for  finding  sub- 
optimal  solutions  that  are  within  a  given  percentage  of  the  optimal  and 
also  for  finding  the  best  suboptimal  solution  under  a  solution  time 
constraint. 
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V.     CONCLUSIONS 

The  branch -and -bound  algorithm  can  successfully  find  the  optimal 
route  for  a  variety  of  sequence  dependent  routing  problems,   including 
those  with  symmetric  cost  matrices,  when  the  matrices  of  all  possible 
costs  for  each  leg  of  the  route  is  known.     On  the  basis  of  experience 
with  the  traveling  salesman  problem,  the  branch -and -bound  routing 
algorithm  is  expected  to  be  competitive  with  dynamic  programming  for 
routes  involving  fewer  than  15  nodes  and  superior  for  larger  problems. 
Under  the  branch-and -bound  algorithm,   storage  requirements  may  be 
traded  for  increases  in  solution  time  and  the  number  of  computations. 
This  trade-off  is  accomplished  by  the  selection  of  the  branching  strategy 
used  in  the  algorithm.     Experience  from  digital  computer  runs  is  neces- 
sary to  provide  more  quantitative  recommendations  for  branching  pro- 
cedures.   Finally,  only  the  branch-and-bound  algorithm  provides  a 
rapid  suboptimal  solution  when  these  are  acceptable. 
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